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A tiieory to predict the steady state position of a dissipative, flow-controlled system, as defined 
by a control volume, is developed based on the Maximum Entropy (MaxEnt) principle of Jaynes, 
involving minimisation of a generalised free energy-like potential. The analysis provides a theoretical 
justification of a local, conditional form of the Maximum Entropy Production (MEP) principle, which 
successfully predicts the observable properties of many such systems. The analysis reveals a very 
different manifestation of the second law of thermodynamics in steady state flow systems, which 
provides a driving force for the formation of complex systems, including life. 
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1. INTRODUCTION 

For over three decades, the Maximum Entropy Pro- 
duction (MEP) principle - more precisely termed the 
"maximum rate of thermodynamic entropy production" 
principle - has been found to give successful predictions 
for the steady state properties of a variety of dynamic, 
many-degree-of- freedom systems subject to flows of mass, 
energy, momentum, charge and/or with chemical reac- 
tions. Prominent examples include the global general cir- 
culation (atmospheric and oceanic) system of the Earth 
0, 0, 1 i, i, i, 0, S & E, [il [il 111 and possibly 
other planetary bodies [14ill5|: turbulent convection in a 
heated fluid (Ravleigh-Benar d llal convection) JJ] , man- 
tle convection in the Earth [iSl. [Tol. [20| and moons of 
Jupiter and Saturn global Earth-biosphere water 

and nutrient cycles [9, 21, 22], vegetation spatial dis- 
tributions [23|, biochemical metabohsm [11] and ecosys- 
tem operation The Earth climate models include 
quite accurate predictions of the mean latitudinal air 
temperature, fractional cloud cover, meridional heat flux 
[l|, mean vertical air temperature profile, vertical heat 
flux [1] and historical latitudinal air temperature gradi- 
ents over decadal and glacial-interglacial time scales [l^j ■ 
The MEP principle has also been invoked for the expla- 
nation of shear turbulence (Couette flow) (l7|, in com- 
pressible and compressible turbulent fluid flow 2u\, cur- 
rents in electrical circuits [27, 28, 29, 30], plasma forma- 
tion [m and structure [11] , crystal growth ^ , chemical 
cycle kinetics [s^], diffusion in non- uniform solids [ssl . 
photosynthesis mechanism [s^ . biomolecular motors [33] 
and economic activi ty |38l] : several detailed reviews are 
available [1, [uj, [H, |4^The MEP principle has even 
been invoked as a technical basis for the Gaia hypothesis 
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[10|,l21|,|41|,|42]. The apparent successes of the MEP prin- 
ciple - which can exclude most details of the dynamics 
- contradict the prevailing paradigm of developing ever- 
more-complicated dynamic models of complex systems, 
for example the general circulation models (GCMs) of 
the Earth climate system. This suggests that in a large 
class of steady state systems, the dynamics adjust them- 
selves to achieve a state of MEP, rather than the entropy 
production being a consequence of the dynamics. This 
implies the action of an as-yet unrecognised physical prin- 
ciple applicable to flow systems - beyond the domain of 
present-day thermodynamics - which provides the driv- 
ing force in the system, and so can be used as a "short- 
cut" in system modelling. 

In recent years, several workers have attempted to jus- 
tify the MEP principle on theoretical grounds. Dewar 
[43, 13 analysed a time- variant, non-equilibrium sys- 
tem in terms of its available paths in parameter space; 
the transient and steady state positions are inferred 
by the maximum entropy (MaxEnt) method of Jaynes 
[li, m, 113, m, m, US iHll, using an entropy defined on 
the set of paths. The analysis has received some criti- 
cisms [5^ [53} , to suggest it might apply only in the near- 
equilibrium linear (Onsager) regime, in which fiuxes are 
linearly proportional to their driving gradients 54, 5^. 
Attard [Sa, [S^] also gives an analysis based on an entropy 
defined on transition probabilities, but cast in the termi- 
nology of traditional statistical mechanics (although he 
denies the MEP principle in favour of an alternative). 
Beretta [H, |H, [60, HH examines a steepest entropy as- 
cent principle for transitions between states, based on 
a quantum thermodynamics formulation. Other argu- 
ments for MEP have been given by Zupanovic and co- 
workers [sl], based on the "most probable" increase in 
entropy during a fluctuation (also criticised [s^). and 
by Martyushev [6>|] , based on a frame of reference (rela- 
tive velocity) argument. Of course, this is a well-trodden 
field, with many historical antecedents to the MEP prin- 
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ciple (see the fascinating review by Martyushev and Se- 
leznev [1^). If the above objections can be overcome, 
the path-based analyses hold the promise of predicting 
the behaviour of time-variant systems (transport phe- 
nomena). However, they seem unnecessarily complicated 
for the task of predicting the steady state position, when 
(as will be shown) a more direct method is available. 

The aim of this work is to outline a theory to directly 
predict the steady state position of a flow-controlled sys- 
tem based on Jaynes' MaxEnt method [H, [H, \^ \^ 
|49| . [sol , [sij . The analysis provides a theoretical deriva- 
tion of a local, conditional form of the MEP principle for 
steady state thermodynamic systems of any type (e.g. 
heat flow, fluid flow, diffusive flow, electrical flow, chem- 
ical and process engineering, biological and human sys- 
tems). The appro ach taken here differs from previous 
analyses [43l. 144.15^ IstI [6^ in that it considers flux rather 
than path probabilities, to directly obtain the steady 
state position. It also employs the local equilibrium as- 
sumption commonly used in engineering control volume 
analysis, but does not appear to be restricted to the lin- 
ear transport regime; indeed, the linear regime emerges 
as a first-order approximation to the analysis. 

This work is set out as follows. In ^ the princi- 
ples of Jaynes' generic theory are outlined, leading in 
[J3]to a discussion of different types of physical systems, 
which influences the manner in which Jaynes' method 
can be applied. Equilibrium systems are first examined, 
to demonstrate the universality of Jaynes' method and to 
highlight the (easily overlooked) equilibrium analogue of 
the MEP principle. In SJH a theory is developed to pre- 
dict the steady state position of a flow-controlled thermo- 
dynamic system; by comparison to a traditional control 
volume analysis, this is found to give a local, conditional 
form of the MEP principle. The implications of the anal- 
ysis for the formation of complex systems, including life, 
are discussed in iJH 



2. JAYNES' GENERIC THEORY 

We first summarise Jaynes' generic formulation of sta- 
tistical mechanics [H, El, Si HI [i^ [13, [Ml, based 
on the minimum divergence, maximum relative entropy 
or minimum cross-entropy (MinXEnt) principle, within 
which the maximum entropy (MaxEnt) principle can be 
considered a special case. Consider a system of N dis- 
crete, distinguishable entities distributed amongst s dis- 
tinguishable categories or "states" within a system, with 
constant source ( "prior" ) probabilities qi for the filling 
of each state i — l,...,s (the states i may be multi- 
variate, e.g. 7, ■■■})■ From information-theoretic con- 
siderations Im. [Sal and/or by combinatorial arguments 
[H [§3, [11,161, [^ [nj, it can be shown that in the 
asymptotic limit N ^ oo (the Stirling approximation 
[73 | or Sanov's theorem [z3|)i the "least informative" or 
"most probable" distribution of the system is obtained 
by minimising the KuUback-Leibler cross-entropy func- 



tion [TJ, UM (ths negative of the relative entropy function 
0)1: 



(1) 



subject to the natural and moment constraints on the 
system, respectively: 



i=l 

s 

^ ^^ Pifri (/r 



(2) 



(3) 



where pi is the probability of the ith category, fri is the 
value of property for the ith category and {fr) is the 
mathematical expectation of f^i (generally, each is a 
"conserved quantity"). Applying Lagrange's method of 
undetermined multipliers to ((Ij-Q gives the stationary 
or most probable distribution of the system: 



Pi 



r = l 



E 



(4) 



where is the Lagrangian multiplier for the rth con- 
straint, Ag is the "Massieu function" [t^, Z* is the 
generalised partition function and "*" denotes a quan- 
tity at the stationary position. Here "stationary" im- 
plies a time-invariant distribution ^ , with no additional 
physical interpretation. Subsequent generic analyses pi- 
oneered by Jaynes iM, i£L, ilS, i4E, iSfl, i51, ilfl] give the 
relations: 



dXr 



-{fr) 



a^A 



d{Ir) 



--{frf,n)~{fr){f,n) 



dXr 
djfr) 
5Am 



(5) 

(6) 
(7) 



djfrn) 
dXr 



(8) 

R R 
dD* = -Y^ Xr (d{fr) - SWr) = - ^ XrSQr (9) 



where SWr — {dfr) — J2i=lPi'ifri ^^'^ ^Qr = 

Si=i dp*fri can be identified, respectively, as the incre- 
ments of "generalised work" on the system and "gen- 
eralised heat" added to the system during a change in 



^ Use of the continuous form of JTJ, or the von Neumann entropy 
based on density matrices, requires different mathematics but 
gives essentially the same macroscopic results l|4j-(|9j |46l. |47|| . 



3 



the rth constraint d(fr), in which Sx denotes a path- 
dependent differential. (A path is here defined as a spec- 
ified trajectory in macroscopic coordinates, e.g. constant 
constraints {(/r)}, constant multipliers {A^} or some 
mixed form.) To avoid double counting, the SWr terms 
represent generalised work processes in addition to those 
introduced by other constraints^. 

For equal qi ~ s^^, the foregoing analysis reduces to 
that of maximising the Shannon entropy [64| : 



(10) 



subject to the same constraints ([I])-©. This gives the 
same relations (g])-®, except that D* is replaced by —S)* 
and the Qi cancel from (g]). 

It is important to note that relations ([4])- ([9]) only con- 
cern the stationary position, i.e. they apply "on the man- 
ifold of stationary positions" . Transitions between sta- 
tionary positions are thus assumed to be quasistatic, i.e. 
they are idealised as taking place only between stationary 
positions, without any intermediate non-stationary posi- 
tions [Z^]. Comparing ([9]) to the derivative of ^ gives 
the differential: 



del)* = -dX* = -d\nZ* = Y >'rSWr + J2 dKifr) 

r—1 r—1 
R R 

= dD* +YXrd{U) +YdXr{fr) (11) 



dcf)* therefore encompasses "all possible changes" in the 
stationary position, due to changes in the constraints, 
multipliers or cross-entropy (generalised heat input) . For 
constant multipliers, d(j)*\{\^} is equal to the weighted 
change in generalised work on the system; its integrated 
form 0* can therefore be regarded as a generalised, di- 
mensionless free ener gy-l ike function or generalised po- 
tential Hi, m, 113, HM mi ■ 

We now come to the central tenet of this analysis, 
the importance of which will become clear in [JSj-fJH If 
a dynamic system described by and pT|) contains 

mechanism(s) by which its generalised potential (jf can 
be dissipated (converted to an unrecoverable form), by 
processes not represented in the constraints, then by suc- 
cessive increments d(jf < it will converge to a station- 
ary position of no further extractable generalised work 
d4>* = 0, equivalent to the minimum position (f)* = ^^jj,. 
We here confine the discussion to systems with repro- 
ducible dissipative phenomena, whereupon (/iJijin '^i^l be 
predictable (i.e. (jf is a state function). If the incremental 
changes are restricted in some manner - e.g. the system 



^ This point is further explained in il3.1l and footnote O by refer- 
ence to an example equilibrium system. 



is confined to a constant-constraint {(/r)} or a constant- 
multipher {Xr} path - then (j)^^^ will be the local (path- 
dependent) minimum. If there is no such path restriction, 
'Knin ^ill constitute the global minimum. 

It is emphasised that the above analysis p])- pTl) is 
generic, and applies to any probabilistic system which 
can be analysed by the KuUback-Leibler cross-entropy 
^ or Shannon entropy (|10p . Although its primary ap- 



plication has been to equilibrium thermodynamics, the 
analysis has far broader power of application [4^, |4^i ESj 
m, |4l, 113, HH. For this reason, the symbols used above 
are generic, and should not be interpreted in terms of par- 
ticular thermodynamic quantities except when so stated 
(e.g. the generic entropy ^ should not be confused with 
the thermodynamic entropy S). 



3. TYPES OF SYSTEMS 



3.1. Quantity-Constrained (Equilibrium) Systems 



Isolated system 

{</^)=const.} 

e.g. {U),{V),{{nc)],.. 



(a) 



Impermeable wall 



(b) 



I Diffusiye-L^ Physical 
I system — quantities 

I I {^rl 

Bath 

{X^const.}, e.g. T,P,[\y^,... 



Flows 
const.} 




(c) 



Control volume 



FIG. 1; (Color online) Different types of physical systems: (a) 
isolated, (b) diffusive and (c) flow-controlled (control volume). 

To understand the application of MinXEnt, we now 
consider several types of probabilistic systems composed 
of discrete entities, as illustrated in Figure [1] Histor- 
ically, Jaynes' method (and its predecessor, traditional 
statistical mechanics) has been applied to (a) isolated 
(microcanonical) systems (Figure [T^), held in a state of 
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constant mean contents (fr) of various physical quanti- 
ties fr by isolation from the rest of the universe; and (b) 
various types of open or diffusive (e.g. canonical, grand 
canonical) systems (Figure [T}d), open to the diffusion of 
various quantities fr but with no directed flows, and in 
contact with infinite generalised baths of constant corre- 
sponding Xr [4^. Clearly, such representations are con- 
venient models to enable the construction of thermody- 
namic relationships: no system can really be isolated from 
the rest of the universe, whilst the mechanisms used to 
maintain the generalised baths are not usually explained. 
Notwithstanding this criticism, in either case the "least 
informative" or "most probable" position of the system 
- the equilibrium position - can be calculated by the ap- 
plication of MinXEnt (or, for equal qi, by MaxEnt) sub- 
ject to the natural and moment constraints ^45i] . Jaynes' 
generic formulation (fj2]) can then be applied to the anal- 
ysis of such systems. 

As an example, consider an "open" or "heterogeneous" 
thermodynamic system for which the "entities" are inter- 
preted either as discrete particles (atoms, ions, molecules, 
etc) or, in the Gibbs-Einstein representation, as dupli- 
cates of the entire system [t^ [t^ [s^I • Each entity has the 
choice of its (quantised) internal energy Ui, « = 1, ■■■,s; 
volume element Vj, j = and moles of particles 

TT-TVe of each chemical species c = 1, ...,C, for which the 
number of particles Nc can range between zero and (effec- 
tively) infinity. The system is constrained by its natural 
constraint ([2]), mean internal energy (U), mean volume 
(V) and mean moles of particles (uc) of each type c. As- 
suming, from the principle of insufficient reason [5l| , that 
each multivariate state {i, j, {Nc}} is equiprobable, we 
maximise the Shannon entropy: 



s t 00 oc 00 



i=l j=l Ni=0 N2=0 Nc=0 

(12) 

subject to the constraints, giving the equilibrium position 
©: 



(13) 



<^lj,{N^} = exp{-XuUi - XyVj - ^ AcnjvJ, 

c=l 

s i oc oc oc 
i=l j=l Ni=0 N2=Q Nc=0 



From our existing (historical) knowledge of thermody- 
namics (e.g. by monotonicity arguments (soj or from the 
zeroth law of thermodynamics [491 Isoj). we can identify 
the Lagrangian multipliers Xjj = 1/kT, Xy = P/kT and 
Ac = —fic/kT as functions of the Boltzmann constant k, 
absolute temperature T, absolute pressure P and molar 



chemical potential fic of each species c, whence: 



/ a, PVj M-^ ficnNc\ 

«...{^.} = ^^p[-kf -Tr+Y -rr) ' (14) 



and is the grand partition function. Recognising the 
thermodynamic entropy as 5 = kSj^q, ^ and ^ give: 



^* = fcln- + iE^ + ^-5:^ (15) 



T T ^ T 

c=l 



dS* 



SQu , P5Qv \ " f-cSQ 



l.(d{U) - SWu) + ^{d{V) - dWv) 



J2t^{d{nc)-SWn 



(16) 



T 



d{U) Pd{v) ^ ncdjuc) ^ ^icSWn^ 

T T T ^-^ T ^ T 



where 5Qu^ 5Qv and 5Qn^ are the increments in gen- 
eralised heats, and SWu^ 5Wv and 5Wn,^ are the incre- 
ments in generalised work, associated respectively with 
constraints (C/), {V) and {nc). In the first line of (fT6|) . the 
first two terms can be amalgamated into the (actual) heat 
term 5Q /T used in thermodynamics; for systems with in- 
variable particle numbers, 5Qn^ = and reduces to 
the Clausius [8l| equality dS* = 5Q/T. Similarly, in the 
last line of pB]) . the 8Wu and PSWy terms are amalga- 
mated into the combined (actual) work ^ 6W\ the latter 
therefore represents the total (actual) work on the sys- 
tem, in addition to the Pd{V) and ^cd{nc) work'^. For 
this study, we ignore relativistic or other changes in the 
"mass levels" , and set J2 ^^n^ = 0- It is again empha- 
sised that p^ - pB|) apply only to quasistatic transitions, 
in this case "on the manifold of equilibrium positions" . 

Eqs. (fTTj) and (fT5l) - ((T6| give the change in the (actual) 



^ As mentioned in [[2l the hWv refer to work terms in addition 
to those introduced by the other constraints. Thus in the above 
equilibrium system, the Pd(V) work cannot be introduced within 
the work term &Wu associated with (C/), since it is already in- 
cluded by virtue of the (V) constraint. Similarly, hWij can- 
not include the chemical potential work terms iicd{nc), since 
these are included by the (rtc) constraints. This consideration 
is quite general: the constraints [fr) must be linearly indepen- 
dent, but need not be orthogonal; the weighted generalised work 
terms \r&Wr therefore cannot include processes represented by 
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free energy function, in energy units: 
dJ* = kTd(l)*q = -kTdlnE* 

C 

= -TdS* + d{U) + Pd{V) -^HcdM (17) 

+ tU^) (u) + dQ {V) <t) K)| 

c=l ^ 

in which, from (|16p . the first four terms on the right 
correspond to the total work ^ 5W . Note that - as 
per Gibbs [H, HI] - we could restrict (fTT]) to these 
first four terms, by imposing the Gibbs-Duhem relation 
J2r=i ^"^r (fr) = 0. Wc here wish, however, to consider 
all possible changes in J*, allowing both Gibbs-Duhem 
paths and non-Gibbs-Duhem paths. Integration of (fTT]) 
from a zero reference state then yields^: 

J* = kT(t)l^ = -fcTlnS* 

= -TS* + {U)+P{V)-J2f^M ^^^^ 

Although less well known, J* was reported by Gibbs [83| : 
in modified form, it forms the basis of the available en- 
ergy, essergy and exergy concepts [H, [13, HE HI) 113, Hlj 
|89| . For constant composition, J* reduces to the Gibbs 
free energy G* = -TS* + (U) + P{V) plus a constant, 
whilst for constant composition and volume, it gives the 
Helmholtz free energy F* = —TS* + (U) plus a constant. 

We first examine ( [T 71)- P^ from the original perspec- 
tive of Gibbs [82, [S^see also S S HJ. Following 
the standard treatment, we consider an open system 
surrounded by an intensive variable bath (Figure [Hd), 
with the double system-bath isolated from the rest of 
the universe; a single isolated system (Figure [1^) can 
then be considered as a special case. From ([TC)) -([T7 | . 
dJ*\T.p,{fi^} — J2^^ gives the total change in work on 
the system along a Gibbs-Duhem path, due to processes 
not represented in the constraints. Thus dJ* |t,p,{/jc} ^ 
indicates spontaneous change (work extraction) and 
<^<^*It,p,{/jc} > a forced change (work input). If the sys- 
tem contains some reproducible dissipative process(es) 
by which work can be expended (e.g. friction [i^, [i^ or 
chemical reactions (9^l93j|). it will move towards the equi- 
librium defined by dJ*\x^p,{f_t^} — 0, or in other words, to 
the minimum free energy position J* = Jmin- This was 
implicitly understood by Gibbs ^S^], who refers to the 
equilibrium surface (the "fundamental relation" or Euler 
surface) as the "surface of dissipated energy" . If no work 
is extracted in useful form, each increment of lost work 



* Strictly speaking, we must integrate k d<f>*g and multiply by T, 
an awkwardness produced by the conversion of InS* to energy 
rather than entropy units (see Appendix |A}. Alternatively, inte- 
gration of c'J*|t,p,{/jc} directly yields JTS) [sSl . 



is given by [H, [si, [oll : 

rfJ*lT,p,{Mc} = -TdS*\T,P,{^^} - TSa\T,p^{^^} < (19) 

where dS*\T.p^{fj.^} and Sa\x.p^{fj.^} respectively give the 
change in entropy within and outside the system. Eq. 
(|19p represents the net irreversible increase in entropy in 
the double system-bath (converted to energy units and 
with change of sign), reflecting the interplay between ir- 
reversible change within the system, and the exporting 
of irreversible change to the bath by the transfer of gen- 
eralised heats [c.f. IM HI, H S Isll ■ The second term 
Salx.p^lfj.^} can be labelled the entropy produced^ by the 
system, since it materialises outside rather than inside 
the system. If the incremental losses are unrecoverable 
(i.e. dS*\T,p.{fj,^} > and Sa\T.p,{fj.^} > 0), the equilib- 
rium position J* — Jj^j„ will correspond to the position 
of maximum entropy produced, a = CTmax [c.f. l93j. 

We now go a step farther than Gibbs, to consider sys- 
tems which can deviate from a Gibbs-Duhem path during 
dissipation. We again only consider systems with repro- 
ducible processes. Here it is preferable to use the poten- 
tial dtp* = kd(j)lg = dJ*/T (t he g rand potential form of 
the negative Massieu funct ion |76| or negative Planck po- 
tential [13, [9I [13, [9i, H [T00|-see Appendix E| rather 
than dJ*, to more effectively handle changes in temper- 
ature. From P?)) . each increment dtp* < can be di- 
vided into two parts: (i) the part d?/'* |5*^([/)^(y)^{(„^)i, <0 
which is expended against changes in the intensive vari- 
ables, causing an irreversible loss of "ability to do gener- 
alised work" , manifested as an increase in entropy within 
or outside the system, and (ii) the part d'(/'*|T,p,{^c} < 0' 
which - as in p9p - is lost by dissipation within or outside 
the system. The net loss can thus be written as: 

dip* = -dS'*|T,p.{Mc} ~ '5o'It,p,{a<c} 

- dS*\s-',{U),{V),{{n.)} - S<7\s',{U),{V),{{nc)} 

= -dS* - (5a < (20) 

The terms dS*\s" ^(u),{v),{{n.)} and Sa\s' ,{u),{v),{{n,)} 
constitute "uncompensated transformations" of Clausius 
[Slj - respectively within and outside the system - since 
they involve irreversible change(s) in one or more inten- 
sive variables. For convenience, the four terms are unified 
in the second line of (|20p . into overall entropy changes 
within and outside the system. 

From (j20p . the system will approach the equilibrium 
position defined by V'* = i^mim equivalent to the maxi- 
mum net irreversible increase in entropy within and out- 
side the system. If dS* > and 5a > 0, this will again 



^ It is misleading to call a the entropy production. In English, 
"production" implies an on-going phenomenon, hence a rate pro- 
cess (e.g. a nation's steel production). This can only apply to a 
flow system. Confusingly, the symbol a is used interchangeably 
for the amount of thermodynamic entropy produced by a system, 
its rate of production by a system or the rate per unit volume; 
these are labelled ct, a and a respectively here. 
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correspond to the state at which maximum thermody- 
namic entropy is produced, a — <Jmax- If the path of 
possible transitions is prescribed (e.g. constant {(/,)}, 
constant {A^} or a mixed choice), the system will ap- 
proach the local minimum 4'min ~ ~ lidS* + Sa) along 
that path; if not, it will converge to the global minimum. 

Thus in a dissipative, equilibrium system, the final 
equilibrium will occur at the position of minimum gener- 
alised potential 0*^ (maximum Massieu function Xq). If 
the incremental increases dS* > and 5cr > are unre- 
coverable, this will be equivalent to the position at which 
maximum thermodynamic entropy is produced. This 
provides an equilibrium analogue of the MEP principle, 
which is easily overlooked, since it involves a connection 
between equilibrium states and irreversible changes. 

We can also consider the multiplier relations ([5]), vari- 
ances ([7]) and covariances , which yield a highly impor- 
tant set of relations for equilibrium systems, as list ed in 
Table n These include the "Maxwell relations" (ttI.IioH. 
which express the connections between various material 
properties or susceptibilities of the system (e.g. heat ca- 
pacity, compressibility, coefficient of thermal expansion, 
activity coefficients, etc). The relations in Table U are 
valid only at equilibrium; i.e. they apply on the manifold 
of equilibrium positions. Although discovered long be- 
fore Jaynes' generic analysis, such relations demonstrate 
the power of Jaynes' method, particularly when applied 
to new situations. 



3.2. Flow-Controlled (Steady-State) Systems 



TABLE L Multiplier relations (|6]), variances (O and covari- 
ances ((S)) for the example equilibrium thermodynamic system 
( jjS.lf) at equilibrium (note var(a) — (a?) — (a)^, cov(a,6) = 
{ab) — {a){b), and implies b ^ c). 

Multiplier relations 

(y)= -kT 



dT /p,{mc} 
ainH*^ 



dP /t,{m,} 



Variances 

,ar(f/) = fcr2f^) 
var(F) = 

\ dP JT,{l^a} 



' d{nc) 
dfic /t,p,{m6} 

Covariances (Maxwell relations) 

^ ' ' \ dP JT,{^a} V dT ) P,{t,^} 

cov{U,nc)= [-^—^ ] =T( 

cov{V,nc)=-( „p =(-5 

cov(nc, nt) = I — I = I — 1 



d^b /T,P,{m^_^6} V /T,P,{Mt,} 



We now examine a third kind of probabilistic system, 
which much more closely matches our experience of real 
systems and of life on Earth: the flow- controlled sys- 
tem (Figure [T};) , constrained by flows of various phys- 
ical quantities fr through the system. Flow-controlled 
systems are familiar to fluid mechanicists and engineers, 
as defined by the control volume, a geometric region 
through which fluid(s) can flow (the Eulerian descrip- 
tion), bounded by its control surface. In the language of 
statistical mechanics, flow-controlled systems constitute 
a separate "ensemble" , very different to those examined 
in equilibrium thermodynamics. For the simplifled flow 
system shown in Figure [TJ;, the mean rate of change of 
each conserved quantity fr with respect to time t within 
the system is: 

{-^ r)in (.^ out {fr) prod (^I) 

where {Tr)in, {J^r)out and {fr)prod represent, respec- 
tively, the mean flow rates of fr into and out of the con- 
trol volume, and rate of production within the control 
volume. At steady state, d{fr)/dt = 0, and so for a sys- 
tem with no production terms, (j21[) reduces to: 

r)in — r) out — r) (^^) 



The mean flow rates (.?>) can then be interpreted as con- 
straints on the distribution of instantaneous flow rates 
J-'ri thr oug h the system. By information-theoretic rea- 
soning [m, |65|1 and/or the combinatorial basis of entropy 
[H [63,B1S IZO, IzII, the MinXEnt principle can then 
be used to calculate the stationary or "most probable" 
distribution of flow rates within the system - its steady 
state position - subject to the constraints on the system. 
Moment constraints are just moment constraints, regard- 
less of their physical manifestation. In consequence, the 
entirety of Jaynes' generic approach can be applied 
to the analysis of steady state, as well as equilibrium, sys- 
tems. Of course, flow-controlled systems may be subject 
to variable or cyclic flow rates, causing deviations from 
the steady state position; such effects are not considered 
further here. 

Notwithstanding the broad applicability of Jaynes' 
method to both equilibrium and steady state systems, 
it is important to understand their differences. In equi- 
librium systems, the physical "entities" represent indi- 
vidual particles (e.g. molecules, ions, oscillators, etc), or 
entire systems of such particles, which can choose differ- 
ent values fri of various physical parameters fr ■ In con- 
trast, in the Eulerian description of a steady state system, 
the "entities" represent individual fluid elements (in the 
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limit, points), which may adopt particular instantaneous 
flow rates J^ri through the system. The latter analysis 
therefore examines the bulk behaviour of many individual 
particles passing through a control volume, which cannot 
readily be ascribed to particular particles. A further dis- 
tinction is that equilibrium systems require no effort to 
maintain equilibrium, and can undergo reversible or irre- 
versible changes; in contrast, maintenance or alteration 
of steady state systems inherently requires an irreversible 
change in the universe. Aside from these differences, both 
systems have many features in common: 

• In keeping with any method of inference, there is no 
guarantee that a predicted stationary position will oc- 
cur, in that there may be (unknown) dynamic inhibi- 
tions ( "non-ergodities" ) which prevent its occurrence. 
Indeed, in equilibrium thermodynamics the existence 
of "metastable" states is well known, and is dealt with 
by kinetic theory (rate processes) and the activation 
energy concept. However, if the analysis incorporates 
everything that is known about the system, Jaynes' 
method will provide the "best representation" and "ex- 
pected position" of the system [43|. In this vein, whilst 
it may be desirable to seek "mechanistic" or "dynamic" 
explanations for the observed steady state in particu- 
lar flow-controlled systems - analogous to justifications 
of equilibrium using the equations of motion 102] or 
Boltzmann's H-theorem [103] - the general principle 
must necessarily be inferential (statistical or probabilis- 
tic), just as it is in equilibrium thermodynamics. 

• For a given constraint set, the stationary position D* 
ov f)* is usually considered unique within its parame- 
ter (state function) space [H [ll, [13, [H [49, 50, b% 
However, this depends on the type of constraints; e.g. 
power-law constra ints are known to give multiple sta- 
tionary positions jl04| . Uniqueness of the stationary 
position, in general, is therefore not claimed here, but 
is correct in the case of linear moment constraints [50| . 

• A unique stationary position D* or fy* in parameter 
space does not imply uniqueness of the dynamic struc- 
ture(s) which can produce it; indeed, many such struc- 
tures may be possible. The occurrence of any given 
structure will depend on the interplay between the sys- 
tem history (hysteresis phenomena) and the dynam- 
ics (the extent of fluctuations, or "jitter" , in the sys- 
tem), both of which lie outside the domain of Jaynes' 
method per se. This feature is also well known in equi- 
librium systems: e.g. the equilibrium position of a su- 
persaturated solution does not provide any information 
about the particle size distribution or geometric form of 
the precipitant, which instead will depend on localised 
(history-dependent) nucleation, crystallisation and dif- 
fusion phenomena. 

• The MEP principle has been criticised for appearing to 
be a means of selection between a few isolated optima, 
rather than a true variational principle (iol . Is^ . How- 
ever, many equilibrium systems also exhibit a discon- 
tinuous approach to equilibrium for dynamic reasons. 



Flows 
of {Q 




Discrete \q 
element |j j 



FIG. 2: (Color online) Discretised control volume model of a 
flow-controlled thermodynamic system. 



especially those with a phase change; e.g. the rapid 
solidification of a saturated solution of sodium acetete 
trihydrate - which can dissolve in its own water of crys- 
tallisation - when tapped. The equilibrium between 
nitroglycerine and oxygen also illustrates this point. In 
flow-controlled systems, we might expect any locally 
optimal steady states {(l)lpt} to be similarly narrowly 
defined, since they may require special coordination of 
flows in different domains. Thus although derived by 
variational means, there is nothing wrong with the min- 
imisation of (j)* as a selection principle. 

The rationale for the analysis of a steady state system by 
Jaynes' method is therefore identical - with many of the 
same caveats - to that for equilibrium systems. 



4. ANALYSIS OF FLOW-CONTROLLED 
SYSTEMS 

4.1. Control Volume Analysis 

Calculation of the steady state position of a flow- 
controlled system can now proceed, firstly involving a 
traditional engineering thermodynamic analysis. Con- 
sider the control volume shown in Figure [21 divided into 
infinitesimal volume elements, each of which is assumed 
to satisfy the "local equilibrium assumption" . This al- 
lows the definition of local specific (per unit mass) quan- 
tities including specific internal energy u, specific volume 
p^^, specific moles rric of each species c and specific en- 
tropy s of each element, where p is the fluid density, as 
well as intensive variables such as temperature T, pres- 
sure P and molar chemical potentials pc of each species 
c on its boundary. The elements are thus sufficiently 
small for local equilibrium to hold, but obviously repre- 



8 



sent averages over regions large enough to be considered 
a thermodynamic continuum. In general, for an element 
subject to the total entropy flux^ 3s,tot^ the volumetric 
rate of entropy production within the element (SI units: 
and over all rate of production (J K^^ 
ITofillToTi: 



J K-^ m- 
s-i) are [92 



dps 
~dt 



> 



adV > 



(23) 
(24) 



cv 



where V = [d/dx, d/dy, d/dz]^ is the Cartesian gradient 
operator; a-b is the vector scalar product (dot product); 
and is the transpose of a. For an element with mean 
local heat flux jg, diffusive mass fluxes of each species 
c (relative to the mass-average velocity v through the el- 
ement), viscous stress tensor'' r and molar rate per unit 

volume of each chemical reaction d = 1,...,Z), from 
the conservation of energy, mass, momentum and chem- 
ical species, the total entropy flux and rate o f ent ropy 
production per volume reduce to 92, 105, IOGI. llOTf : 



MrT 



^^3c 



Jc ■ 



c=l 



McT J T 



(25) 



(26) 



where A : B is the tensor scalar product; ab is the vec- 
tor dyadic product (often simply written ab); Mc is the 
molecular mass of species c; is the specific body force 
on each species c; and — X^JjLi '^cd is the molar 
chemical affinity of reaction d, wherein Vd is the stoichio- 
metric coefficient of species c in the dth reaction (vcd > 
for a product and A^ < denotes spontaneous forwards 
reaction). Alternative formulations o f (|26p are available 
for different situations jlOSl . Il06l . Il07l | ; the present formu- 
lation is sufficiently broad for the present discussion. 

In engineering modelling, the local mass, momen- 
tum and energy conservation equations and local en- 
tropy production (|26p are usually non-analytic, and so 
are calculated on a two- or three-dimensional grid of fi- 
nite rather than infinitesimal domains (e.g., by the fi- 
nite element method) such that the local solutions are 



° We adhere strictly to engineering convention: a flow is measured 
in SI units of quantities s~^, whilst a flux is expressed in quan- 
tities . 

The viscous stress tensor t is equal to the net or molecular stress 
tensor Fl less the uniform pressure component P, whence t = 
n - P(5, where 6 is the Kronecke r de lta tensor llOSl . llOSl . Il07(l . 
The stress notation of Bird et al. [l07j | is adopted here, in which 
P > and Tij > denote compression. 



self-consistent and match the boundary conditions and 
source-sink te rms of the overall control volume [s^ llOSl 
IIOGL IIOTI Il08l |. This approach assumes that the calcu- 
lated solution is unique. However, for many flow systems, 
the entropy production (|26p is indeterminate, since one 



or more of the fluxes (jg, j^,, t and i^^) and/or gra- 
dients (V(r-i), V(Mc/r), gjT, V{v/TY and AJT) 
across the overall control volume are unknown, there be- 
ing no principle within equilibrium thermodynamics by 
which they can be determined. In such cases, ([26|l has 
been solved by assuming the near-equilibrium linear (On- 
sager) regime, for which closure of the equations can be 
attained by the use of the equilibrium Gibbs-Duhem re- 
lation. Curie postulate, tensor symmetry and specifica- 
tion of the (l inea r ) ma s s, rn omentum and energy diffusion 
coefficients [lOSl Il06l Il07l |. Outside the linear regime, 
such as in turbulent fluid flow, these assumptions can 
produce serious computational difficulties (e.g. the need 
for extremely small elements) and are commonly handled 
by broad simplifications or empirical rules. Indeed, for 
many flow systems, the entropy production is completely 
disregarded. Eqs. (|^ - (|^ therefore apply to a flow- 
controlled thermodynamic system at steady state, but in 
many systems, may not uniquely define the steady state. 



4.2. Jaynes Analysis 

We now examine a flow-controlled system from Jaynes' 
perspective {^^. In general, for an infinitesimal fiuid 
element of a control volume, Jaynes' relations for the 
steady state position are exactly as given in ([4)l- (fTT|) . but 
this time with mean fiux constraints instead of quan- 
tity constraints (/, ) (for convenience the (■) notation is 
dropped), and increments in generalised heat fiuxes (5q,. 
instead of in the generalised heats 5Qr- The Lagrangian 
multipliers, say Cr, will of course be different to those 
of equilibrium thermodynamics A^, conjugate to the flux 
constraints considered. We should also denote the cross- 
entropy or entropy by some special symbol, e.g. Dst or 
9) St, to emphasise that it applies to a steady state system, 
and is quite different to that for an equilibrium system, 
Deq or S^eq- Our gcucric analysis of the steady state 
position of a flow-controlled system is now complete, re- 
quiring only the substitution of relevant parameters for 
the system under consideration. 

Returning to the example of i i|4.1i we consider that each 
element can experience instantaneous values of the heat 
flux jq J, mass fluxes jj^^ of each species c, stress tensor 

T J and reaction rates S^Cd , where the indices X, J , Cd and 
A/'c can (in principle) take any value. The system is con- 
strained by mean values of the heat fiux j'q, mass fluxes 

j'f,, stress tensor r and reaction rates ^d through or within 
the element, and by the natural constraint ([2]), where ex- 
pectations are taken with respect to the joint probabil- 
ity TT/ = 'Kx._j^{Cd}.{J^c} instantaneous fluxes. As for 
the equilibrium analysis ( ij3.ip we assume equiprobable 
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states, and thus maximise the Shannon entropy: 



4.3. Synthesis 



oo oo oc oo oo oo 

= - E E E - E E - E ^/InTTj, (27) 

1= J= Ci= Co= ^fi= Mc = 
— oo — oo — oo — oo — oo — oo 

subject to its constraints. From Q-llS]) and ([9]): 

/ C D ^ 

13*1 = exp ( -Cq ■ Jq^i - E • - Cx : T J - E '^'^^'^'^ 



oo oo oo oo oo oo 



d=l 



^* = ^^«*-E E E-E E-E/31 (28) 

1= J= Ci= Cd= J^i= ^fc = 
— oo — oo — oo — oo — oo — oo 

C D ^ 

= In Z* + Cq ■ JQ + ^ Cc • + : ^ + E Cd^d 



£i=l 



(29) 



c=l d=l 

(30) 

where the multipliers Cq, Cc, Cx ^ii'i Cd are associated 
with the heat, species, stress tensor and reaction con- 
straints (Cq and Cc are vectors and C-r a second order 
tensor); Sqq, Sq^, Sq^ and Sq^ are the corresponding 
changes in generalised heat fluxes; Co is the Massieu func- 
tion and Z* — e^o the partition function. We see that 
is a dimensionless flux entropy. Eqs. and (|29p - ([5n|) 
then give the change in a generalised potential function 
for steady state systems: 

C D ^ 

= -d^jlf + Cq • djQ + ^ Cc • dj, + C^-dT + Y^ Cddid 

c=l d=l 
C D ^ 

+ dCq -JQ+Y. -Jc + dC-r-^ + Yl '^'^^^d (31) 

c=l d=l 

Again - with Gibbs - we could exclude a net change in 
the multipliers Cr, giving d(f>lf.\^^^j ~ X]^=i CrSwr, where 
dwr are changes in generalised work fluxes, in addition 
to those incorporated by other constraints. However, as 
with equilibrium systems fi i3.ip . we wish to consider all 
possible variations of Integration of ((3T|) . from the 
zero flux, zero multiplier (equilibrium) position 0*jq 
-^*sto yields: 

(32) 

This is the steady state analogue of the equilibrium gen- 
eralised potential (j)*^. Relations ((28|) - (|32l) apply only to 
quasistatic transitions "on the manifold of steady state 
positions". However, in this case - since this is a flow 
system - they always involve irreversible processes. 



We can now combine the control volume (glUl) and 
Jaynesian ft i4.2p analyses of the example problem (Fig- 
ure 12). Since the fluxes in and ([5^ are linearly 
independent (not necessarily orthogonal), it is possible 
to equate similar terms, giving the following identities: 



Cq - 



OV. 



ev 

k 



1 

T 



\McT 



T 



C. 

Cd 



k T 



(33) 
(34) 

(35) 

(36) 
(37) 



where 6 and V respectively are characteristic time and 
volume scales for the system considered, which emerge 
from the fact that Sj^f and each product in ([5^ must 
be dimensionless^'^. 

From and the foregoing analysis (iJH and H3.ip . 
if the flow-controlled system contains some process(es) 
which dissipate its generalised potential 0*^ , it will move 
by increments: 



ev - 

-dS)* - —5a < 
k ~ 



(38) 



until it converges to a final steady state position given 



by = 0, hence at minimum c/)*^. Eq. (j38[) is analo- 
gous to ((20|) for equilibrium systems, accounting for the 
loss of generalised potential within and outside the sys- 
tem. If dSjlf. > and S& > 0, the steady state position 
0*4 = will correspond to the position of maximum 

entropy production a = &aia.K- The analysis therefore 
provides a theoretical justification for a local form of the 
MEP principle, conditional on the assumption that incre- 
mental increases in Sj*^ and & are unrecoverable. As with 
equilibrium systems f< j3.ip . the dissipation may be con- 
fined to a constant-multiplier {Cr}, constant-constraint 
{jr} or mixed constraint path, leading to a local (path- 
dependent) minimum (f)*^ or may be free to choose 
its own path, whereupon it will attain a global minimum. 

Processes for which Sir > (to which the MEP princi- 
ple applies) are here termed exoentropogenic^^ , since they 



* An alternative view, not considered further here, is to inter- 
pret (8V/k) (Qc/T) ■ as a generalised work flux, which must 
be subtracted from a redefined generalised heat flux 5q'. = 
(eV/k)^{pJM,T)-j^. 

^ Note 9V has SI units of m-^ s, equivalent to a four-dimensional 
space-time element, or action divided by pressure. 
From ancient Greek: exo-, outer or external (obverse endo-, 
within or internal); tropos, transformation (used by Clausius 
[sill): and -genie, generating or producing. 
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result in the production of entropy and its export to the 
rest of the universe. Exoentropogenic processes are one 
class of processes leading to the formation of steady-state 
flow systems, in the same way that exothermic reactions 
- in which the heat SQ < - are one class of processes 
which generate equilibrium systems. It is left as an open 
question here whether exoentropogenic processes (and 
hence the MEP principle) are universal in application, 
or are merely an important class of processes applicable 
to flow systems at steady state. 



4.4. Implications 

The analysis has several important implications. 
Firstly, under conditions in which the MEP principle ap- 
plies, from dill) and ((33)l : 

• If the fluxes or rates jg, j^, r and in are indeed 
constant, the system will achieve MEP by maximising 
the magnitudes of the gradients or forces |V(r^-'^)|, 
|V{Mc/r)|, \ajT\, \V{vlTy\ and |^<j/T| across or 
within each element, each weighted by its conjugate 
flux term. Since the gradients can be interpreted as 
measures of disequilibrium of the system, we see that 
a flow-controlled system is driven to a steady state po- 
sition of maximum disequilibrium. 

• If, on the other hand, the gradients or forces V(T~^), 
V{nc/T), gjT, V{v/Ty and A^/T in 1^ are fixed, 
the system will be driven to maximise the fluxes or rates 

J'q' Jcj ^-nd £,d, again in the form of a weighted sum. 
In other words, the most probable response of a system 
to gradients or forces in one or more intensive variables 
Xr is the occurrence of flow of the corresponding phys- 
ical quantities fr, at their maximum mean flow rates. 
This is also consistent with maximum disequilibrium of 
the system. 

The distinction between fixed flux j^, (Neumann) or in- 
tensive variable gradient VA^ (Dirichlet) boundary con- 
ditions is well known in the solution of differential equa- 
tions. In the MaxEnt analysis of a steady state system, 
the choice between such boundary conditions plays ex- 
actly the same role as the choice between fixed content 
(fr) or intensive variable A^- constraints in an equilibrium 
system, or in other words, between corresponding micro- 
canonical and canonical representations. Although the 
two representations within each pair are different, the 
mathematical apparatus used to examine either set of 
constraints is the same [c.f. |45|. Flow-controlled systems 
can also be subject to composite flux-gradient (Robin) 
boundary conditions, or a mixed set of conditions, giving 
rise to steady states which have no equilibrium analogue 
in quantity-constrained systems. 

To achieve maximum a in (|26p . the conjugate vectorial 
fluxes and gradients should be coUinear. A consequence 
of the MEP principle is that the free fluxes or gradients 
will try to orient themselves to attain coUinearity, to the 
maximum extent allowable by competition between dif- 



ferent flows and/or by anisotropy within the system (e.g. 
due to the velocity gradient). Similarly, the system will 
endeavour to align its principal stresses with the principal 
directions of the velocity gradient. This may provide an 
explanation for the many simplifications used in control 
volume analysis, such as tensor symmetry. 

Whilst ((26|) is in differential form, in systems with 
simple boundary conditions it may be possible to ap- 
ply its finite difference approximation to much larger 
domains. This appears to be the case for the Earth 
climate system, which has been analysed (on a whole- 
Earth scale) using sirnple two-box or ten-box models 
[E S 1 i> i i, a S i, 0, [m, El p. The analysis 
also indicates MEP to be a local principle, which need 
not apply to the universe as a whole. Only the entropy 
production of a system - not the entire universe - is max- 
imised, since it is only within a system that there exist 
mechanisms by which the MEP state can be attained. 
This is a characteristic feature of previous applications 
of the MEP pri ncip le, which has incited much debate 

Tidying up the analysis, (|33l) -([37 l) can be substituted 
into Steady state analogues of the four laws of 

equilibrium thermodynamics can also be obtained from 
Jaynes' approach [49,,^], as set out in Appendix IbI We 
can also consider the set of multiplier relations ^ , vari- 
ances (O and covariances ^ for steady state systems, 
examined further in Appendix [Cl The analysis there- 
fore provides a set of testable laws and transport rela- 
tions for the behaviour of steady state thermodynamic 
systems. Furthermore, as shown in Appendix [Cl the On- 
sager linear regime emerges as a first-order approxima- 
tion to the analysis, in the vicinity of equilibrium. The 
analysis therefore provides a general mathematical for- 
malism for the analysis of flow systems - including non- 
equilibrium thermodynamic systems - both near and far 
from equilibrium. 

This is as far as our comparative analysis of steady 
state thermodynamics can take us, using the parame- 
ters of equilibrium thermodynamics, and it is important 
that it not be taken too far. For example, in many sys- 
tems the local equilibrium assumption - which forces the 
MEP principle to adopt a local formulation - may be 
too restrictive; such considerations lead into the domain 
of more complicated appr oaches, su ch as extended irre- 
versible thermodynamics |l09l Ill0l |. For more compre- 
hensive treatments it may be necessary to abandon the 
connection with equilibrium parameters, and conduct the 
steady state analysis using the "raw" Lagrangian multi- 
pliers - or some functions thereof ~ obtained directly 
by MinXEnt. The raw multipliers (the "ideal" gradients) 
could then be correlated to the actual gradients by gra- 
dient coefficients, analogous to the activity and fugacity 
coefficients of equilibrium thermodynamics. In some sys- 
tems, it may even be necessary to adopt process- and 
direction-specific time and volume scales Onj and V„j 
(possibly also varying with position), leading to weighted 
scales Ogys and Vgys for the system as a whole. The anal- 
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ysis extends naturally to further developments, for ex- 
ample the use of a "local steady state assumption" in 
the analysis of transient phenomena. This leads into a 
higher-order theory of acceleration phenomena, in which 
a maximum is sought in the sum of products of acceler- 
ative transport terms dj^/dt and gradients of the gra- 
dients V^J (a conditional, maximum a principle) |lll| . 
an idea best examined elsewhere. 



5. DISCUSSION 

The foregoing analysis would be incomplete without a 
brief account of its implications. From 21 MEP emerges 
as a local, conditional principle, in which each local con- 
trol volume behaves as an actor or agent which seeks to 
minimise its generalised potential (/)*( , and hence (condi- 
tionally) to maximise its local entropy production. This 
provides a driving force for the formation and reinforce- 
ment of "emergent" self-organisation of the system as a 
whole, since by such "cooperative federalism" , each local 
"selfish" control volume can achieve much higher entropy 
production than it could of its own volition. We therefore 
see that the MEP principle drives the formation of struc- 
ture and Junction. Of course, this does not in any way 
preclude the development of competition between con- 
trol volumes - or even between associations of control 
volumes or entire systems - for a greater share of gen- 
eralised potential; such competitive forces are certainly 
well known to us. These twin effects, a predominant, 
higher level cooperation and a lower level (but occasion- 
ally overwhelming) competition, are the hallmark of the 
"dynamic steady state" of a dissipative, flow-controlled 
system. 

The analysis therefore confirms a number of aspects 
of the philosophy of Prigogine and co- workers on non- 
equilibrium, dissipative systems [H, [H, Ill2l Ill3j | , even 
though his "minimum entropy production principle" 
(valid only in the linear regime) is quite different pTi. l39j| . 
It also pr ovide s an explanation for the "constructal law" 
of Bejan |114| : "For a finite size flow system to per- 
sist in time (to survive) its configuration must evolve .. 
[to] provide easier and easier access to the currents that 
flow through it. " Furthermore, it confirms the essence 
of the (no n-ma thematical) gradient theory of Schneider 
and Sagan jll5l | , who argue that "Nature abhors a gradi- 
ent"; i.e. the occurrence of flow is a natural response to 
a physical gradient. 

Finally, the analysis goes to the heart o f the "rid- 
dle of life" posed by many scientists [e.g. Ill6l Ill7l |. 
concerning the perceived contradiction between the 
second law of thermodynamics and the existence of 
life. To recap: it is one thing to suggest that life can 
form, in that its ability to increase the thermodynamic 
entropy of the universe exceeds the reduction of entropy 
associated with its structure. But if life were merely 
an accident - a fluctuation - why should it not just 
die out? Why should it be so resilient to extreme 



events, as evidenced by its regrowth after the many 
mass-extinction episodes in the history of the Earth? As 
shown, the existence and evolution of life is drive n by 
a deeper, purely probabilistic form of the second law [7]| : 

"j4 system tends towards its most probable form.^^ 

This "MaxProb" principle [el, 13, [H, [gi, H [zll , applied 
to an isolated or open, dissipative equilibrium system, 
drives the system towards the equilibrium position ii*^ 
or S* of minimum generalised potential 0*^ (e.g. mini- 
mum free energy F* , G* or J*), since this is more proba- 
ble than other forms of the system. In contrast, in a flow 
system it provides a driving force for the formation of 
complex, dissipative structures, including life, to attain 
the local steady state position of minimum gener- 
alised potential hence (conditionally) of maximum 
(T, since this position - not the equilibrium position - is 
more probable than other realisations of the system. The 
above probabilistic statement of the second law therefore 
contains within it both a "force of death" and a "force 
of life" , associated respectively with constraints on the 
mean contents {fr) or fiuxes (j^) (or their corresponding 
multipliers). It also implies a surprising inevitability to 
the evolution of life in a flow-controlled system, whenever 
the conditions are suitable, and indeed, of other complex 
systems such as fluid turbulence, biological and ecologi- 
cal structures, transport and communications networks, 
economic systems and human (or sentient) civilisation. 



6. CONCLUSIONS 

In this study, a clear distinction is made between 
(i) quantity- controlled systems^ constrained by a set of 
mean physical quantities {fr) and/or their correspond- 
ing multipliers A^, which converge towards an equilib- 
rium position, and (ii) flow- controlled systems, as de- 
fined by a control volume (the Eulerian description), 
constrained by a set of mean fiuxes {j^) and/or their 
corresponding multipliers C,-, which converge towards a 
steady state position. A theory to determine the steady 
state position of a flow-controlled thermodynamic system 
is derived using the generic MaxEnt principle of Jaynes 
[M IS 113, EE H S [Ell, [11. The analysis is shown 
to yield a local, conditional form of the MEP principle. 
It also yields steady state analogues of the four laws of 
equilibrium thermodynamics, and sets of multiplier, vari- 
ance and covariance (Maxwell-like) relations applicable 
to flow-controlled systems at steady state. The derivation 
is limited to reproducible flow-controlled systems, but 
does not appear to be restricted to the near-equilibrium 
linear regime; indeed, the latter can be recovered as a 
special case (see Appendix [C]) . The analysis reveals a 
very different manifestation of the second law of ther- 
modynamics in steady state systems, which provides a 
driving force for the formation of complex, dissipative 
systems, including life. 
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Further work is required on the scope of the present 
analysis, and the relationship between concepts devel- 
oped here and those of others; e.g. between the steady 
state generic entropy Sj*^, t he p ath-based entropies of 



Dewar [43|, |4j| and Attard 156. l57ii a nd the quantum 



formulation of Beretta [H, l59l . GOL l6ll| . Greater atten- 
tion should also be paid to the tremendous power of 
the MinXEnt / MaxEnt method pioneered by Jaynes 
psi . m, [47I, lisl. [jgl [sol. Isil , a nd its combinatorial (proba- 
bihstic) basis [66l. l67l 1681. l69l. [toI. [Tlj . 
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APPENDIX A: TERMINOLOGY 

From the foregoing discussion (especially it is 

evident that there are difficulties in terminology concern- 
ing the negative Massieu function (p* = — Aq = —InZ*. 
Although described herein as a free energy-like concept 
or "generalised potential" , from ^ it has more in keep- 
ing with an entropy-related quantity. In equilibrium sys- 
tems, is usually multiplied by kT to give the free 
energy; but as shown in ij3.11 it is more appropriate to 
multiply it by k, to avoid complications with changes 
in the intensive variables. The free energy concept of 
Gibbs [1^, designed purely for changes in the extensive 
variables, is thus less versatile than the slightly older 
concept of Massieu (t^, adopted by man y we ll-known 
thermodynamicists [e.g. O, M, S M, S [lo3 for this 
reason. Concepts related to the free energy, such as es- 
sergy and exergy [H, [H [H, [13, S HI , suffer from the 
same disadvantage (a further disadvantage is their need 
for an unchanging reference system). In steady state sys- 
tems, we could multiply by kT/OV to give the "free 
power", or by k/'V{T~^)9V to give a flux analogue, but 
neither choice makes much sense, and would involve the 
same awkwardness in the handling of intensive variables 
as does the free energy. If must have units, it is prefer- 
able to multiply it by k/OV to give it the same units as 
being of opposite sign, we could call this (as would 



cr; 



Gibbs [83|) the "available ca paci ty for entropy produc- 
tion" or (as would Brillouin [ll8| |) the "free negentropy 



production" . Provided that the dissipative processes are 
macroscopically reproducible, the fact that this quantity 
has entropy units (a non-conserved quantity) instead of 
energy units (a conserved quantity) will not affect its ap- 
plication. 



APPENDIX B: STEADY STATE "LAWS" 

Steady state analogues of the "laws" of equilibrium 
thermodynamics are readily obtainable from Jaynes' 
generic approach [4i,[53]". Although unsurprising, they 
are included here for completeness. Firstly, two control 
volumes which are joined (side-by-sidc) such that their 
fluxes are combined (i.e. {jm)tot = {jm)i + (j'm)2 for 
(im) ^ {(Jr)}) '^ill attain a steady state position of iden- 
tical multipliers {Cm}, and so will share common mth 
gradients; this is the zeroth law. The first law is sim- 
ply a definition of generalised heat and work for the flux 
of a conserved quantity, which at steady state is given 
by d{j^) = 5q,j. + 5wr] thus 5q^ gives a (spontaneous) 
change in the distribution of instantaneous fluxes, whilst 
5wr represents a (recoverable) change in the instanta- 
neous fluxes themselves. The second law can be stated 
in many ways (see 5j5]); in a state function sense, it is given 
by the generalised Clausius equality The third law 

- arguably more of a definition of a convenient reference 
state - can be stated as "the steady state entropy io*^ 
approaches zero at the position of zero gradients" , i.e. 
when it relaxes to an equilibrium position. 



APPENDIX C: JAYNES' RELATIONS 

In linear transport theory, it is common to employ the 
so-called "Curie postulate", in which the scalar, vector 
or tensor fluxes jr, Jr or are assumed to depend on 
forces or gradients of the same type AAy . , or V A J , 
but not on those of other types [lOi, [Tol, [To^, [Hll . This 
postulate cannot be assumed to apply in general. In con- 
sequence, Jaynes' relations (O-® and higher derivatives 
for scalar and each component of vector and tensor mul- 
tipliers in a steady state system will be of generalised 
form: 



-{jr 



— {jr ij ) (jrij) — 



(CI) 
(C2) 



Tribus [49l | would distinguish them as 
and "laws of thermodynamics" . 



'laws of thermostatics" 
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— {jrtjjniKi) {jrij) (jmni) 

d{j„]) _ d{j 



(C3) 



rriKi 



(C4) 



where the expectation notation (■) is reinstated; 
I, J, K, i,ip,'d £ {x, y, z} (with j, £, ■& redundant for vectors 
and all directions redundant for scalars). Each partial 
derivative is taken at constant other Lagrangian multi- 
pliers. 

Relations (|C1[) - (|C3|) for the example system (Figure [2]) 
are listed in Table HIl Analogous to those in Tabled the 
identities in Table |TT] apply only at steady state; i.e. they 
describe quasistatic transitions on the manifold of steady 
state positions. Note that these relations do not impose 
tensor symmetry; e.g. 9(Tjj)/9C-r,, = 5(T,j)/9C-r,, does 
not imply (ti^) = (r,,) unless C-r.^ = C-tj,- 

Furthermore, each flux can be expanded in a Tay- 
lor series about the zero-multiplier (equilibrium) position 
{jrij )|{C,=o} = (see AppendixE]), yielding [73]: 



(C5) 



with the equilibrium-limit derivatives: 



{Cr=0} 



dCrriKldCnip^ 



Close to equilibrium, this can be approximated by dis- 
carding all but the first-order terms: 



Ur 



(C6) 



By the use of Jaynes' method, we therefore recover the 
near-equilibrium linear regime l|C6[) with, from (IC3I) , the 
Onsager reciprocal relations L°nj,mK,i = ^mK£,rij [Si, HI] • 
For simple boundary conditions, these relations may ap- 
ply to the overall system as well as at local scales. How- 
ever, the analysis goes well beyond Onsager's, indicating 
that the reciprocal relations (IC3|) and higher derivatives 
f (|C4p and onwards) also apply well away from equilib- 
rium, at least when expressed in terms of the raw multi- 
pliers (see H4.4p at local scales, although they will not 
then enter into the expansions (|C5P - (|C6|) . Of course, 
the expansion (jC5[) (hence (jC6p ) will become more and 
more inaccurate with increasing distance from equilib- 
rium, even if successively higher order terms are included. 
From (IC4p and onwards, each set of higher order deriva- 
tives will also obey a symmetry relation, both near and 
far from equilibrium. 
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TABLE HI: Nomenclature used in this study (ES — equilib- 
rium system; CV — control volume). 



Symbol Meaning 



Roman symbols 


Aa 


molar chemical affinity of reaction d (Ad < for 




spontaneous forwards reaction) 


C 


total number of chemical species 


D 


KuUback-Leibler cross-entropy function (generic) 


fri 


value of property fr in the ith category (generic) 


ifr) 


mathematical expectation of property fr (generic) 


Tr 


flow rate of property fr (CV) 




instantaneous flow rate of /,. (CV) 


9c 


specific body force on chemical species c (CV) 


S^ 


entropy function (generic) 




instantaneous mass flux of chemical species c 


through element (relative to v) (CV) 


3 s,tot 


total thermodynamic entropy flux (CV) 


jc 


mean mass flux of chemical species c through ele- 




ment (relative to v) (CV) 


3q 


mean local heat flux through element (CV) 


3q,i 


instantaneous value of heat flux through element 


(CV) 


J 


free energy for system with ([/), (V) and (ric) con- 




straints (ES) 


k 


Boltzmann constant 


mc 


specific (per unit fluid mass) moles of particles of 




chemical species c (CV) 


Mc 


molecular mass of chemical species c 


{ric) 


mean moles of particles of chemical species c (ES) 




moles of particles of chemical species c (ES) 


N 


total number of particles or entities 


Pi 


probability of the ith category (generic) 




joint probability of each category in ES 


P 


absolute pressure (P > for compression) 


Qi 


source (prior) probability of ith category (generic) 




increment in "generalised heat" flux associated 




with rth constraint (CV) 


SQ 


increment in actual (thermodynamic) heat (ES) 


5Qr 


increment in "generalised heat" associated with 




rth constraint (generic, ES) 


R 


total number of moment constraints 


s 


number of categories (generic, ES); specific ther- 




modynamic entropy (CV) 


S 


thermodynamic entropy (ES) 


T 


absolute temperature 


t 


time 


u 


specific (per unit fluid mass) internal energy (CV) 


{U) 


mean internal energy (ES) 


u. 


internal energy level (ES) 


V 


mass-average velocity through element (CV) 


V 


volume 


{V) 


mean volume (ES) 


Vj 


volume element "level" (ES) 


V 


characteristic volume length scale (CV) 




increment in "generalised work" flux associated 




with rth constraint (CV) 


5W 


increment in actual (thermodynamic) work (ES) 


SWr 


increment in "generalised work" associated with 




rth constraint (generic, ES) 




partition function (generic) 


Z 


partition function (CV) 



18 



TABLE III: (continued) 



TABLE III: (continued) 



Symbol Meaning 



Symbol Meaning 



Greek symbols 

a* J {iVe} defined in ^ (ES) 
(3*1 ' " defined in ^ (CV) 

5 Kronecker delta tensor 

^0 Massieu function — Lagrangian multiplier for the 

natural constraint (CV) 
C,r Lagrangian multiplier for the rth constraint (CV) 

6 characteristic time length scale (CV) 

Ao Massieu function — Lagrangian multiplier for the 

natural constraint (generic, ES) 
Xr Lagrangian multiplier for the rth constraint 

(generic, ES) 

fj,c molar chemical potential of chemical species c 

Vcd stoichiometric coefficient of chemical species c in 

the dth reaction {i/cd > for a product) 

extent of chemical reaction d 

mean molar rate per unit volume of chemical re- 
action d (CV) 

instantaneous molar rate per unit volume of chem- 
ical reaction d (CV) 
H grand partition function (ES) 

TTj joint probability of each category in CV 

n net or molecular stress tensor in element (CV) 

p fluid density 

<r entropy produced and exported from system (ES) 

& rate of production of thermodynamic entropy in 

control volume (CV) 

& rate of production, per unit volume, of thermody- 

namic entropy in element (CV) 

T mean viscous stress tensor in element (wherein 

Tij > for compression) (CV) 

Tj- instantaneous value of viscous stress tensor in el- 

ement (CV) 

ijj negative Planck potential for system with (U), (V) 

and (ric) constraints (ES) 
(jj potential function (generic) 

Superscripts 

* at a stationary position 



Subscripts 



CV 
d 

eq 
i 

hJ 

T 

I 



i 

J 



chemical species index (ES); pertaining to the j ^ 
constraint (CV) 
control volume (CV) 

chemical reaction index (ES); pertaining to the 
constraint (CV) 

an equilibrium (quantity controlled) system (ES) 
index of categories (generic); index of energy levels 
(ES) 

Cartesian coordinate indices 
index of instantaneous heat flux (CV) 
joint index of heat flux, mass fluxes of chemical 
species c, viscous stress tensor and rates of chem- 
ical reactions d in element (CV) 
into control volume (CV) 
index of volume elements (ES) 
index of instantaneous viscous stress tensor (CV) 
Cartesian coordinate indices 

index of instantaneous rate per volume of chemical 
reaction d (CV) 



max maximum 

min minimum 

m index of the mth constraint (generic) 

n index of the nth constraint (generic) 

ric pertaining to the (tIc) constraint (ES) 

Nc number of particles of chemical species c (ES) 

A4 index of instantaneous mass flux of chemical 

species c (CV) 

O'pt optimum 

out out of control volume (CV) 

Q pertaining to the jg constraint (CV) 

r index of the rth constraint (generic) 

st a steady state (flow-controlled) system (CV) 

U pertaining to {[/) constraint (ES) 

V pertaining to (V) constraint (ES) 

T pertaining to the r constraint (CV) 

(y3, •& Cartesian coordinate indices 

Mathematical symbolism 

(a;) mathematical expectation of x 

dx total differential of x 

5x path-dependent differential of x 

V Cartesian gradient (vector) operator 
V- Cartesian divergence (scalar) operator 
var(a) variance of a 

cov(a, h) covariance of a and b 

a vector quantity 

aJ transpose of a 

a ■ b vector scalar product (dot product) 

ab^ vector dyadic product 

A tensor quantity 

A : B tensor scalar product 

X rate of production of x within control volume (CV) 

X rate of production per unit volume of x within 

control volume (CV) 

x\a,b,... quantity x taken at fixed values of a,h, ... 

y^*" X sum of X from a to 6 



